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Abstract. We study probability measures on the unit circle corresponding 
to orthogonal polynomials whose sequence of Verblunsky coefficients is invari- 
ant under the Fibonacci substitution. We focus in particular on the fractal 
properties of the essential support of these measures. 



1. Introduction 

There is a well known one-to-one correspondence between probability measures 
on the unit circle and a class of five-diagonal matrices, the so-called CMV matrices. 
Let us recall this correspondence. 

A CMV matrix is a semi-infinite matrix of the form 
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\w\ < 1} and p n = (1 — lani 2 ) 1 / 2 . C defines a unitary 
operator on i? 2 (Z + ). 

CMV matrices C are in one-to-one correspondence to probability measures p 
on the unit circle <9B that are not supported by a finite set. To go from C to p, 
one invokes the spectral theorem. To go from p to C, one can proceed either via 
orthogonal polynomials or via Schur functions. In the approach via orthogonal 
polynomials, the a„'s arise as recursion coefficients for the polynomials. 

Explicitly, consider the Hilbcrt space L 2 (dD,dp) and apply the Gram-Schmidt 
orthonormalization procedure to the sequence of monomials 1, w, w 2 , w 3 , . . .. This 
yields a sequence </?o, Vi, ¥>2> V3> • • • °f normalized polynomials that are pairwise 
orthogonal in L 2 (dD, dp). Corresponding to <p n , consider the "reflected polynomial" 
(f* n , where the coefficients of ip n are conjugated and then written in reverse order. 
Then, we have 

Vn+l(w)\ _ _! / W -a n \ (<p n {w) 

y n+1 (w)J Pn { -a n w 1 J \<p'(w) 



(1) 
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for suitably chosen a n £ D (and again with p n = (1 — lanl 2 ) 1 / 2 ). With these a„'s, 
one may form the corresponding CMV matrix C as above and obtain a unitary 
matrix for which the spectral measure corresponding to the cyclic vector Sq is 
indeed the measure y, we based the construction on. 

Depending on whether one starts out with the coefficients or the measure in 
this one-to-one correspondence, one obtains direct and inverse spectral theory in 
this setting. In this paper we will start out with the coefficients and study the 
associated measure. The coefficients a n will be chosen to be invariant under the 
Fibonacci substitution S : a <— > ab, b i— > a. The study of this particular case was 



begun by B. Simon in Section 12.8 of 35 , where it was pointed out that it is a 



natural problem to pursue this analysis further. Given the recent advances on the 
analogous problem in the world of orthogonal polynomials on the real line [3|[8|[40] , 
it is now a good time to carry out this investigation. 

Let us discuss the model in more detail. Given a sequence {a n } n >o of Verblunsky 
coefficients that take only two values a, j3 £ B, we view it as an element of {a, /3} z+ . 
The substitution S may be extended by concatenation to {a, /3} z+ , that is, the 
one-sided infinite word ujqujiuj2 ■ ■ ■ £ {a, /3} z+ is sent to the one-sided infinite word 
S(u>o)S(uii)S(u>2) ■ ■ ■ £ {a,/3} z +. There is a unique fixed point, namely, ui a ^ = 
af3aaf3 . . . £ CI. It can be obtained by iterating S on a. Indeed, the sequence 
of finite words a — S°(a), af3 = S 1 (a), af3a = S 2 (a), af3aa(3 — S 3 (a) clearly 
converges to an element of {a, f3} z+ (in the sense that each of these finite words is 
a prefix of the limit word) and any infinite word that is fixed under S arises in this 
way. The associated CMV matrix will be denoted by C UJa fi . 

We will study the probability measure on the unit circle corresponding to 
the sequence of Verblunsky coefficients given by u a .p for a, f3 £ D, that is, 
0iQtt\0iia,-i0i/± . . . = afiaafi . . .. Recall that the (topological) support of . is 
the smallest closed subset of <9B so that its complement has zero measure with 
respect to fJ> a ,f)- Removing isolated points from this set, we obtain the essential 
(topological) support of [i Ua fj . We will denote this set by E Q i( gJ^J 

It is natural and often beneficial to embed these considerations in a subshift 
context. Given the fixed point /i Wcv a of S defined above, let us denote by £l a ,p C 
{a,/3} z+ the set of all one-sided infinite words that agree locally with u) a p, that 
is, infinite words that have the same set of finite subwords as w Q)J g. The set £l a ,p 
is called the subshift generated by the substitution S on the alphabet {a,j3}. If 
we consider a sequence of Verblunsky coefficients following some uj £ Cl a g, then 
the associated probability measure on the unit circle will be denoted by fj, u and 
the associated CMV matrix will be denoted by C w . The essential spectrum of C u , 
and hence the essential (topological) support of fx u , is independent of uj £ Cl a ,p and 
hence it is equal to S alpha, p- That is, results for S Q ,/3 will be of relevance for the 
OPUC problem associated with any ui £ Q ai p. On the other hand, the measures 
/luj themselves are not independent of uj £ VL a> g and hence a finer analysis of the 
properties of these measures will have to take this into account. 

2. Trace Map, Invariant, and the Curve of Initial Conditions 

From the letters a, j3 of the alphabet define the constants p = y/l — \a\ 2 , a = 
y/l — |/3| 2 , and K — 2(1 — Re(a/?)). The fundamental quantity is x n (w), half the 



^The set ^ a ,p ls the spectrum of the natural two-sided extension £ a g of C a g, acting unitarily 
on P(Z). 
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trace of the 2x2 transfer matrix associated with the sequence u} a ,p of Verblunsky 
coefficients across /„ (the n th Fibonacci number) sites|^] 

x n (w) = -w~ fn/2 TiT fn (w;iJ, ul ). 
These traces obey the recursion 

(2) — 2x n X n —\ X n — 2 



35 



if we define Xq to be (w 1 ^ 2 + w 1 ' 2 )/(2a) and x_i to be K/(2pa); compare 
Theorem 12.8.5]. The traces x n (w) are important because w € S Q ^ if and only if 



x n (w) is a bounded sequence ( 35, Theorem 12.8.3]). 
The quantity 

I(w) = x 2 n+l {w) + x 2 n (w) + a£_i(u>) - 2x n+ i(w)x n {w)x n -i(w) - 1 
depends on w but not n\ see [35j Theorem 12.8.5]. By choosing n = 1 we then get 
/(w) = x 2 (w) + Xq(w) + x^ 1 (w) — 2xi(w)xo(w)x-i(w) — 1 

Xfw + 2 + w" 1 ) 



Jf 7V<7 2 + (w + 2 + w;" 1 )/^ 2 + (to + 2 + w _i )/4p 2 

/ 1 1 K \ K 2 -2K 1 1 
= Rew {—, + —,- ~ 77 77 H . „ o + + - 1. 



4p 2 cr 2 

^2p 2 ' 2cr 2 2p 2 CT 2 J ' Vct 2 ' 2ct 2 ' 2p 2 " ' 

From this it is clear that I(w) is a real number for all w on the unit circle. 
Considering the trace recursion as a map T : M 3 — > M 3 j^] 

T(x,y,z) = (2xy - z,x,y). 

The n-invariance of I(w) comes from the fact that each of the sets 

Sy = {(x, y, z) : x 2 + y 2 + z 2 — 2xyz — 1 = V} 

is preserved by T. If V > 0, then Sy is a smooth, connected, non-compact two- 
dimensional submanifold of M 3 homeomorphic to the four-punctured sphere. When 

V = 0, Sy develops four conic singularities, away from which it is smooth (see Fig- 
ure[l](a)). The surface Sq is sometimes called the Cayley cubic. When — 1 < V < 0, 
Sy contains five smooth connected components: four noncompact, homeomorphic 
to the two-disc, and one compact, homeomorphic to the two-sphere. When V = — 1, 
Sy consists of the four smooth noncompact discs and a point at the origin. When 

V < — 1, Sv consists only of the four noncompact two-discs. Compare with Figure 

HI 

To investigate the dynamics of the trace map, we consider the curve of initial 
conditions 

y/2 +w -l/2 w l/2 +w -l,2 R ^ 

la,p(w) = {Xi(W),X {W),X-i{W)) = 



2p 2a 2pa J 

r\ r\ K \ 
2p' 2^ , 2p^) 

and ask how points on it behave under iteration of the map T. 



2 We use the notation from |34||35| throughout. In particular, the transfer matrix T^(ui; fi) 
is given by a product of k matrices of the form appearing in JIJ and maps (po(w), yJ(io)) T to 
(Vfc(w), <p* k (w)) T . 

3 We denote a point in R 3 by (x, y, z) and for this reason use w to denote the spectral parameter. 
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(a) V = 0.0001 



(b) V = 0.01 



(c) V = 0.05 






(d) V = -0.95 



(e) V = -0.5 



(f) V = -0.1 



Figure 1 . Invariant surfaces Sv for four values of V (figure taken 
from [39]) 



Much of our analysis is based on dynamical properties of this so-called Fibonacci 
trace map - an analytic map defined on K 3 . Its first appearance in the literature 
dates back to early 1980's, when a connection between smooth dynamical systems 
and spectral analysis of quasiperiodic Schrodinger operators was discovered and 



explored in the pioneering works of Kohmoto et al. 23 and Ostlund et al. 26 



In this section we discuss some properties of the Fibonacci trace map, including 
some model-independent results. We then discuss the connection between the Fi- 
bonacci trace map and the essential support of the spectrum of CMV matrices with 
Fibonacci coefficients. This connection is exploited in Section [3] to give a detailed 
description of the fractal nature of the essential support of the spectrum, as well as 
estimates on its fractal dimensions. 

The existing literature on trace maps is extensive, including some rather compre- 
hensive surveys. Since it is not our intention here to give a comprehensive overview 
of trace maps or of their connection with quasiperiodic Hamiltonians, known re- 
sults are quoted only as necessary. We do, however, point, the interested reader to 
[T|[3{ [3l}]33] (and references therein) for a deeper look. 



2.1. Preliminary Results on Dynamics of the Fibonacci Trace Map. 

Clearly T is analytic, is defined on all of R 3 , and is invertible with the inverse 



(3) 



T 1 (x,y,z) = (y,z,2yz-x). 
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Define a smooth three-dimensional submanifold M. of R 3 by 

(4) M := |J S v . 

v>o 

We shall use this notation often. 

In what follows, we shall be concerned with those points in M. 1 whose forward 
semi-orbit under T is bounded; that is, p G M. that satisfy: 

0+(p) := {T n (p)} neN is bounded. 

We similarly define the backward semi-orbit and the full orbit of a point p by, 
respectively, 

T (p) = {T- n (p)} neN and T (p)=0+(p)\JO T ( P ). 

For convenience and brevity, we shall say that a point p satisfies property B (or 
has property B, or is of type B, or is type-H) if p has bounded forward semi-orbit. 

We'll also need to identify points of type B on Sq. Since T preserves Sv for 
every V, and A4 is foliated by {SV}y >0 , our task is equivalent to identifying points 
of type B on Sv, for V > 0. We do this next. 

We begin with a basic result that guarantees that if the forward semi-orbit of a 
point under T is unbounded, then it does not contain any infinitely long bounded 
subsequences. 

Proposition 2.1 (See |3 1 ;| ) . A point peR 3 is either a type-Ti point for T, or its 
orbit under T diverges to infinity superexponentially fast in every coordinate. 

In what follows, we use (standard) notation and terminology from the theory of 
hyperbolic dynamical systems. For a brief overview, see Appendix |A"| below. 

2.1.1. Dynamics of T on the Cayley Cubic Sq. Let T 2 denote the two-dimensional 
torus R 2 /Z 2 , and A : T 2 — > T 2 - an automorphism on T 2 given by the matrix 



(5) A = 



1 1 
1 



Observe that A induces an Anosov diffcomorphism on T 2 . Now, define T : T 2 — » W 3 

by 

(6) F{0,4>) = (cos27r(0 + 0),cos27T0,cos27r0). 

Denote the part of the Cayley cubic that lies inside of the unit cube centered at 
the origin in IR 3 by S. It turns out that S is invariant under T, and the map T 
defines a semiconjugacy between (T 2 ,.4) and (S,T); that is, the following diagram 
commutes: 



T 2 — ^— > T 2 



(7) 



The map J- is not, however, a conjugacy in the sense of (35), since J- is not 
invertible. In fact, (T, F) is a double cover of S. 

By invariance of S under T it follows that all points of S are of type B. Let us 
now see whether there are any other type-B points on Sq. 
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FIGURE 2. The curve p\ in the vicinity of P\ (figure taken from [39]). 

As has been mentioned above, So contains four conic singularities; explicitly, 
they are 

(8) Pi = (1,1,1), P 2 = (-1,-1,1), P 3 = (1,-1,-1), P 4 = (-1,1,-1). 
The point Pi is fixed under T, while P2, ^3 and P4 form a three cycle: 

T T T T „ 

Pi ^ Pi; P 2 ^P 3 ^P 4 ^ P 2 

(which can be verified via direct computation, or by the semiconjugacy As 
it will soon become apparent, it is convenient to work with T := T 6 (the six-fold 



iteration of T) instead of T. By Proposition 2.1 typc-B points of T are precisely 
type-B points of T. 

For each i e {1,...,4}, there is a smooth curve pi, containing no self- 
intersections, passing through the singularity Pi, such that pi \ Pi is a disjoint 
union of two smooth curves — call them p\ and p\ — with the following properties: 

• P^cM; 

• T(p\) — p\ and T{p\) = T{p\). In particular, points of p{ r are periodic of 
period two, and pi is fixed under T, and hence also under T; 

• The six curves p\' r , i = 2,3,4, form a six cycle under T. In particular, 
points of Pi' r , i = 2, 3, 4, are periodic of period six, and hence for i — 2,3, 4, 
Pi is fixed under T. 

The curve pi (see Figure [2| is given explicitly below, as we'll need this explicit 
expression later. 



(9) pi = | \x, xy.xe (-oo, 1/2) U (1/2, oo) 

Expressions for the other three curves can be obtained from ([9| using symmetries 
of T to be discussed below. 

It follows via simple computation that for any i = 1, . . . , 4 and any point p £ p\' r , 
the eigenvalue spectrum of DT p is {1, X(p), 1/X(p)} with < |A(p)| < 1, where DT p 
denotes the differential of T at the point p. The eigenspace corresponding to the 
eigenvalue 1 is tangent to pi at p. At Pi, the eigenvalue spectrum of DT P . is of the 
same form, and as above, the eigenspace corresponding to the unit eigenvalue is 
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tangent to pi at Pj. It follows that the curves {pi} i= i 4 are normally hyperbolic 
one-dimensional submanifolds of M 3 , as defined in Section A. 3 This will be the 
main ingredient in the proof of 

Lemma 2.2. There exist type-H points in Sq \ S; these points form a disjoint 
union of four smooth injectively immersed connected one- dimensional submanifolds 
of So \ §, Wi, . . . , W4, such that for every p £ Wi, we have 

(10) lim f n (p) = P h and f(W t ) = W l . 

n— > 00 

Moreover, for i G {1, ... ,4}, there exists an open neighborhood U of Pi, such that 

(11) for every (x, y, z) <E Wi C\U we have \x\ , \y\ , \z\ > 1. 

In particular, if p 6 Wi, for any i € {1, ... ,4}, then for all n € N sufficiently large, 
all three coordinates of T n (and hence ofT n {p)) are greater than one in absolute 
value. 

Points of Sq not belonging to 8 or lj i Wi are not of type B. 



(We shall need (11 1 later when we investigate fractal properties of the essential 
support of the spectra of CMV matrices.) 



Before proving Lemma 2.2 we mention certain symmetries of the map T which 
can be employed to simplify technical details of some arguments. Indeed, it turns 
out that when proving geometric properties of T, the singularities {Pi} require 
special attention (see, for example, [7j and 39 40]). It turns out that it is enough 
to handle only P\, due to certain symmetries of T. For example, by applying these 
symmetries to p\ in |9j one obtains existence and properties (discussed above) of 
the other three curves: pi, ps and p^. Let us discuss these symmetries now. 

Let us denote the group of symmetries of T by ^ sym , and the group of reversing 
symmetries of T by <? rov ; that is, 

(12) G sym = {s € Diff(K 3 ) : soTos^ 1 = ?} , 
and 

(13) G ICV = js G Diff(M 3 ) : soTo s- 1 = f" 1 } , 

where Diff (M 3 ) denotes the set of diffeomorphisms on K 3 . 
Observe that G rcv ^ 0. Indeed, 

(14) s(x,y,z) = (z,y,x) 

is a reversing symmetry of T, and hence also of T. Hence T is smoothly conjugate 
to T _1 . It follows (see Appendix |a| that forward-time dynamical properties of 
T, as well as the geometry of dynamical invariants (such as stable manifolds) are 
mapped smoothly and rigidly to those of T _1 . That is, forward-time dynamics of 
T is essentially the same as its backward-time dynamics. 

The group g s ym is also nonempty, and more importantly, it contains the following 
diffeomorphisms : 

s 2 : (x,y,z) h-> (~x,~y,z), 

(15) s 3 : (x,y,z) ^ (x,-y,-z), 

s 4 : (x,y,z) 1 ^ (-x,y,-z). 



s 
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Notice that the symmetries {si} are rigid transformations. Also notice that 
(16) 3^) = 

For a more general and extensive discussion of symmetries and reversing symmetries 
of trace maps, see [l]. 

We are now ready to prove Lemma |2.2| 



Proof of Lemma \2.2\ Let us concentrate on the curve p\ and, for statements near 
the singularities, on the singularity P\. The general result will then follow by 



application of the symmetries {si} from (15) 



As has already been discussed, p\ is a fixed normally hyperbolic submanifold of 
M. 3 for the map T. Moreover, Pi\{-Pi} = p\^>p\ belongs to A4 (pi intersects So only 
at the point Pi). Denote the stable set of pi by W s (pi) (see Appendix |A| for defi- 
nitions and notation), and let W ss (Pi) denote the one-dimensional stable manifold 
to Pi in W s (pi). By invariance of the surfaces {£V}, it follows that W ss (Pi) C So- 
Since Pi is a conic singularity of S and Pi £ W ss (Pi), by smoothness of W ss (Pi), 
W ss {Pi) cannot be entirely contained in S, and therefore has a part in the cone of 
So that is attached to Pi . Denote this part by Wi . Since points of Wi converge 
to Pi in positive time, all points of Wi satisfy property B. Moreover, Wi is a con- 
nected smooth injectively-immersed one- dimensional submanifold of Sq \ S (it is 
formed by the intersection of W s {pi) with So\S, and this intersection is quadratic). 

Next let us prove that all points of the cone of S$ attached to Pi other than 
those lying on Wi escape to infinity in forward time. 

From the proofs of Propositions 5 and 6 in [32] , it follows that a point p in the 
given cone does not escape if and only if 

lim T"(» = Pi. 

n— >oo 

Since pi contains Pi and is normally hyperbolic, it follows that p £ W s (pi), and 
hence p € Wi . 

Conversely, if p £ Wi, then since p £ W ss (Pi), 

lim f n (p) = Pi. 

n— ¥ oo 

Invariance of Wi under T also follows immediately from normal hyperbolicity. This 



proves (10) 



To prove ( 11 ) in a neighborhood of Pi, observe that the tangent space to Wi at 
Pi is spanned by the eigenvector of DTp ± corresponding to the eigenvalue which 
is smaller than one in absolute value. A simple computation shows that the z 
component of this vector is positive. Combining this with the fact that the cone 
attached to the singularity Pi does not intersect the unit cube centered at the origin 
at points other than Pi , we get that Wi in a neighborhood of Pi must lie in the 
region where all three coordinates are greater than one. 

Finally, all analogous claims for the other singularities follow by the symmetries 



{si} i=2 3 4 defined in (15), since these symmetries are rigid and Si maps the cone 
attached to Pi to the one attached to Pi\ moreover, all four cones are fixed under 
T. This completes the proof. □ 

2.1.2. Dynamics of T on Sy<o- As was mentioned earlier, the surface Sy, V < 0, 
consists of five connected components, one of which is bounded. It turns out that 
the bounded component is invariant under T, hence consists entirely of type-B 
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points; on the other hand, every point on the non-bounded components escapes to 
infinity (see [3l])- This leads to the following simple result which will be used later 
in Section [51 

Lemma 2.3. For all Vq < and p G Sv of type B, there exists an open neigh- 
borhood B p C Uy<o C K 3 of p, such that every point of B p is also a type-B 
point. 

Proof. If p G Sv , Vo < 0, is of type B, then p belongs to the bounded component 
of Sy. Since the bounded components depend continuously (in fact, analytically, 
since / is analytic) on V, it follows that any sufficiently small neighborhood of p 
is contained entirely in the bounded component of Uv 1 <i/<v 2 ^V, with V% < and 
Vo G [VijVy. In fact, the bounded components of Sy, V < 0, form a smooth 
two-dimensional foliation of the bounded three dimensional manifold obtained by 
taking their union. □ 

2.1.3. Dynamics of T on Sv>o- In the rest of this section, when we write Sy, we 
implicitly assume that V > 0. We'll also write Ty for T\s v , and similarly Ty for 

T\Sy 

The dynamics of the trace map Ty (or, equivalently, of the map Ty) is rather 
complex. This complexity arises from the fact that Ty satisfies Smale's Axiom A - 
a hallmark of chaos (see (36| for the origins of this terminology). Indeed, we have 

Theorem 2.4 (M. Casdagli; D. Damanik and A. Gorodetski; S. CantalQ. The 

set of all bounded (forward and backward) orbits of Sy under Ty coincides with 
the nonwandering set Ay. The set Ay is a compact locally maximal Ty -invariant 
hyperbolic subset of Sy. The periodic points of Ty form a dense subset of Ay . 
Topologically, Ay is a Cantor set. There exists a point in Ay whose forward semi- 
orbit is dense in Ay (i.e., Ty is transitive on Ay). 

A few remarks are in order here, before we continue. First, by nonwandering 
set Ay C Sy we mean the set of those points p G Sv that satisfy the following 
property. For every open neighborhood U of p and for any TV G N, there exists 
n > N such that Ty(U) H U ^ 0. Second, Axiom A diffeomorphisms are those 
for which the nonwandering set is compact and hyperbolic, and periodic points 
form a dense subset of the nonwandering set. That the set of points with bounded 
orbits coincide with the nonwandering set is not part of Axiom A requirements 
(for instance, such a requirement would force every Axiom A diffeomorphism on a 
compact manifold to be Anosov; that is, hyperbolic on the entire manifold). 

Now suppose that p G Sy is a type-B point. Then there exists a point p € Sy, 
such that lim^oo T ni (p) = p, with € N, ri; f °°- The point p is easily seen to be 
nonwandering. In fact, all limit points of 0^(p) are nonwandering. It follows that 
for any open neighborhood U of Ay, for all sufficiently large n £ N, T n (p) G U. 



Since Ay is locally maximal, take U as in ( 33 1 . Now suppose that for infinitely 
many k G N, T k (p) U. Then there exists a limit point of 0^(p) outside of U, 
hence outside of Ay, which cannot be. Hence there exists Nq G N such that for all 
k > N , T k (p) G U; in particular, T N " +1 (p) G U, and so T N °(p) G T^QJ). By 



^The special case of V > 16 was done by M. Casdagli in |4|. D. Damanik and A. Gorodetski 
extended the result to all V > sufficiently small in [7]. Finally, S. Cantat proved the result for all 
V > in pjj. (D. Damanik and A. Gorodetski, and S. Cantat obtained their results independently, 
and used different techniques.) 
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induction, for all k £ N, T N °(p) e T- k (U). On the other hand, f)keN T ~ k ( u ) is 
precisely W s (Ay) n U (see ( |37| for the definition of W s (Ay)) — this follows from 
the general theory (see, for example, the references given in the opening sentence of 



Section A.l ). It follows that p must belong to the stable manifold of some q G Ay. 
In the notation of Appendix |Aj we have p € W s (q) . 

Conversely, if p € W s (q) for some q e Ay, then by definition of the stable 
manifold, we have lim^oo ||T™(p) — T n (q)\\ = 0. Since q e Ay, (q) is bounded, 
hence p is of type B. In other words, we have proved 

Corollary 2.5. A point p is a type-H point in Sy if and only if there exists q £ Ay, 
such that p £ W s (q). 

Observe that as a consequence the set of type-B points on Sy carries the follow- 
ing geometry. It is a disjoint union of smooth one-dimensional injectively immersed 
connected submanifolds of Sy. 



The result of Corollary 2.5 and the corresponding geometry of type-B points have 
been applied in a number of papers investigating spectra of quasiperiodic Hamil- 
tonians, starting with the pioneering work of M. Casdagli in [2j and the following 
work of A. Siito in [37] (see also [8] and references to earlier works therein). Let 



us remark that an explicit proof of Corollary 2.5 isn't found in the aforementioned 
papers, so, while it easily follows from general principles, we included one here for 
completeness. 

While it was enough in those papers to consider the dynamics of Ty for a fixed 



value of V > and the corresponding type-B points, in our case, much like in 40 
we have to consider type-B points in Ai; that is, type-B points of Sy, for all V > 
at once. 

2.1.4. Geometry of Type-H Points in Ai. Let us now discuss the geometry of type- 
B points in Ai. We have already seen above that on Sy, type-B points form a 
disjoint union of injectively immersed smooth one-dimensional connected submani- 
folds of Sy. Since Ai is smoothly foliated by the surfaces {Sy} v>0 , it is natural to 
inquire whether the aforementioned one-dimensional manifolds form a meaningful 
geometric structure in Ai, when viewed simultaneously for all V > 0. To this end 



we have the following result, that originally appeared in 39 . 
Before stating the theorem, we need to define 

(17) A := |J Ay. 

Theorem 2.6. There exists a family, denoted by W s , of smooth 2- dimensional 
connected injectively immersed submanifolds of M., whose members we denote by 
W cs and call center-stable manifolds, with the following properties. 

(1) The family W s is T -invariant; that is, for any W cs G W s , T(W CS ) € W s ; 

(2) For every x £ A, there exists a unique W cs (x) £ W s containing x; 

(3) Conversely, for every W cs € W s , there exists (in fact many!) x € A such 
that x e W cs ; 

(4) For any V > and any W cs € W s , W cs n Sy is precisely the stable 
manifold, W s (q), for some q € Ay; 

(5) For every W cs G W s , W cs intersects Sy for every V > 0, and this inter- 
section is transversal (though the angle of intersection may depend on V 
and on the points along Sy fl W cs ); 
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(6) The type-B points of M. are precisely Uwevv W 



Notice in particular that statement (6) of Theorem 2.6 describes completely the 
geometry of type-B points of M.: it is a disjoint union of smooth two-dimensional 
injectively immersed connected submanifolds of M. 

A detailed proof of this theorem appears in [39] . For completeness we give here 
a rough sketch of main ideas. 



Proof of Theorem 2.6 {sketch). By the fundamental results of hyperbolic dynamics 
that are discussed in Appendix |A| for any Vi > Vq > 0, the dynamics of T\\ Vq is 
conjugate to that of T|a v • That is, there exists a homeomorphism Hy y 1 such 
that the following diagram commutes: 

Avi — ^— > A Vl 



Ay > Ay 

Moreover, Hy y 1 is a unique homeomorphism with this property. 

To prove existence and smoothness of the center-stable manifolds, by the results 



of 20 Section 6] it is enough to show that for any Vi > Vq > 0, 

U ^ 

V <V<V! 

is partially hyperbolic (see Appendix |A| for definitions). But this follows since the 
dynamics of T on 

U Sv 

Vb<V<Vi 

is smoothly conjugated to a skew product of a hyperbolic diffeomorphism on a 
surface with the identity map on an interval (for details, see [40] ) . 

To prove that the center-stable manifolds are transversal to the surfaces 
{Sy} v>0 , notice that, for any fixed x G Ay , and any 7^0, the curve 

V^H Vo , v {x) 

is smooth (indeed, it is the intersection of the center-stable manifold containing x, 
with the center-unstable manifold containing x, where the center-unstable manifolds 
are defined analogously to the center-stable ones for T _1 ). Hence it is enough to 
show transversality of this curve with the invariant surfaces. This follows, since the 



homeomorphism Hy y depends Lipschitz-continuously on V (see 40 for details). 

□ 

The following (at first glance rather unmotivated) result will play a role in the 
spectral analysis of CMV matrices later. 

Proposition 2.7. There are no type-Ti points (x,y,z) € Sy, such that for all k, 
all three coordinates ofT k (x, y, z) remain greater than one in absolute value {recall 
that we are assuming V > 0) . 

Proof. For convenience, let us call the region of interest 1Z: 

K= {(x,y,z) GE 3 : \x\ , \y\ , \z\ > 1} . 
We wish to show that if p is a type-B point in Sy, then for some k > l,T k {p) £ 1Z C . 
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Figure 3. Schematic illustration of the invariant surfaces, the 
curve of initial conditions, and the center-stable manifolds. 



Observe that, according to 31 Corollary 4.1], 1Z does not contain any periodic 
points of Sy- Since periodic points are dense in Ay, we have Ay C 1Z C . Let us now 
prove that for every (x 7 y,z) £ Ay, at least one of the three components is strictly 
smaller than one in absolute value. This amounts to checking a few cases. 

First observe that the singularities {Pi} i=1 4 do not qualify for consideration, 
since they lie on the Cayley cubic So- Before we continue checking the other cases, 
let us mention the following sufficient condition for escape, which we shall use here 
and later. 

Lemma 2.8 (Sufficient Condition for Escape — see [32] Proof of Proposition 5]). 
If \ x \ i \y\ > 1 an d \ x y\ > \ z \> then the point (x,y,z) is not of type B. Hence, by 



the reversing symmetry of T (see (14)), if \y\ , \z\ > 1 and \yz\ > \x\, then (x,y,z) 
escapes under the action of T^ 1 . 

Let us now consider the points (1, 1, —1), (1, —1, 1) and (—1, 1, 1). After iterating 
each of the three points forward or backward, we get: 

T 2 (l,l,-1) = (5,3,1), T 2 (l,-l,l) = (-7,-3,l), T- 2 (-l,l,l) = (1,3,5), 

all satisfying sufficient condition for escape either in forward or in backward time. 
Hence these three points do not belong to Ay . It remains to check for points of the 
form (a,b, ±1), (a, ±1,6) and (±l,a, b), where at least one of \a\ , |6| is larger than 
one, and neither is smaller than one. 

If \a\ , |6| > 1, then (a, b, ±1) and (±1, o, b) cannot belong to Ay by Lemma [2~8] 
Similarly, depending on whether |a| > \b\ or |6| > \a\, either T(a,±l,b) or 



T (a, ±1,6) escapes by Lemma 2.8 so (a, ±1,6) ^ A 
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It remains to check for points of the form (a, ±1, ±1), (±1, a, ±1) and (±1, ±1, a) 
with \a\ > 1. We omit the necessary computations here, remarking that one follows 
exactly the same procedure as above. 

Now, let U be a neighborhood of Ay such that every point of U has at least 
one coordinate strictly smaller than one in absolute value. Say p is type-B in Sy. 
Since p lies on the stable manifold to some q G Ay, for all sufficiently large neN, 
T n (p) e U. This completes the proof. □ 

2.2. Model-Independent Implications. In this section we give a generalized, 
model-independent discussion of techniques that have been useful in spectral anal- 
ysis of quasiperiodic Schrodinger and Jacobi operators (and now also CMV ma- 
trices). Indeed, this generalization is motivated by a rather persistent geometric 
scheme (see [2] , [8] and references therein, 40 and references therein) . We then ap- 



ply the results of this section to derive a topological, measure-theoretic and fractal- 
dimensional description of the essential support of the spectra of CMV matrices 
with Fibonacci Verblunsky coefficients. 

2.2.1. Dynamical Spectrum: Definitions and Basic Results. Given a subset D of 
M 3 , we define the dynamical spectrum of D, denoted by Boo(D), as the set of those 
points of D that have property B: 

(18) B ^(D) := {p e D : p is a type-B point} . 

In the rest of this section and in the next section, we shall be concerned with topo- 
logical, measure-theoretic and (rather nontrivial) fractal-dimensional properties of 
dynamical spectra of compact analytic curves in M. 

For the rest of this section (and, in fact, for the rest of the paper) we assume 
that 7 is a compact analytic curve injectively immersed in R 3 . 

We begin with the following fundamental result. 

Lemma 2.9. Suppose 7 C M.. If 7 does not lie entirely in a single center-stable 
manifold, then it has at most finitely many tangential intersections with the center- 
stable manifolds, while all other intersections are transversal. 

Proof. This result follows by application of [2j Lemma 6.4] to guarantee that tan- 
gential intersections are isolated and hence, by compactness of 7, there cannot be 
infinitely many of them. Indeed, to apply [2| Lemma 6.4], one only needs analyticity 
of 7 and of the center-stable manifolds; the former is one of our current hypotheses, 
while the latter will be proved in the forthcoming paper [14] (for a similar result in 
the context of Anosov diffeomorphisms, see [l3])- □ 



From Section [2. 1[ we know that the dynamical spectrum of 7 is precisely the set 
of intersections of 7 with the center-stable manifolds: 



Soo(7)= (J 7rw cs . 

If 7 lies entirely on a center-stable manifold, then .600(7) = 7. On the other 
hand, if 7 intersects center-stable manifolds only tangentially, then, by Lemma |2.9[ 
Boo is a finite set. Also, Boo is finite if 7 intersects the center-stable manifolds only 
at the endpoints of 7. In this case all is known about Boo- Our next result handles 
the other, far less trivial case: 
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Theorem 2.10. Suppose 7 contains a transversal intersection with a center-stable 
manifold away from the endpoints 0/7. Then -Boo (7) * s a Cantor set, together with 
(possibly) finitely many isolated points. If Boo (7) contains these isolated points, 
then they necessarily arise as tangential intersections of 7 with the center-stable 
manifolds. 

As an immediate corollary of Lemma |2.9| together with Theorem |2.10| we obtain: 

Corollary 2.11. // 7 C M. does not lie entirely in a center-stable manifold, and 
if B x (7) is infinite, then it is a Cantor set, together with (possibly) finitely many 
isolated points; these isolated points, if they exist, are necessarily points of tangency 
of 7 with the center-stable manifolds. 

Remark 2.12. Before we continue, let us remark that while isolated points nec- 
essarily arise as tangencies, a tangency does not necessarily produce an isolated 



point; we shall comment further on this in the proof of Theorem \2.10 below 



Proof of Theorem \2.10[ We first show that isolated points, if such exist, arise neces- 
sarily as tangential intersections. Indeed, suppose p £ #00(7) is a point of transver- 
sal intersection of 7 with a center-stable manifold, and p is not an endpoint of 7. 
Let us call the center stable manifold intersecting 7 at p, W(p). Assume also that 
p £ Sy p , V p > 0. Take a smooth curve r C Sy p passing through p and transversal 
to W(p) fl Sy p (recall: W(p) fl Sy p is a stable manifold to some q £ Ay p ). Since 
the stable manifolds to points in Ay form a continuous lamination (continuous 



in the sense of C 1 -topology — see Section A.l.l), r intersects all stable manifolds 



transversally in a sufficiently small neighborhood U p of p, and hence is transversal 
to the center-stable manifolds in U p . 

With W s denoting the family of center-stable manifolds, as in Theorem |2.6[ and 
W s fl Up - the center-stable manifolds inside U p , define the following map 

(19) £ : Boo(T)nC/ p — >w s nu p 

by 

g(x) = w(x). 

Here W(x) is the part inside U p of the center-stable manifold that contains x. 



The map Q is continuous (see the discussion and references in Section A.l.l) 
in the sense that there exists a family of smooth embeddings {£-x} (r)nu 

of 

the unit disc D into K 3 , such that £ X (H>) = W(x), and these embeddings depend 
continuously on x in the C 1 -topology (actually, in the C fc -topology for any k £ N, 
but k = 1 is sufficient for our means). Since 7 intersects W(p) transversally, it 
follows that if U p is sufficiently small, for all x £ Boo(t) n U p , 7 intersects Q(x) 
(and hence all of the center-stable manifolds inside U p ) transversally. It follows 
that the holonomy map 

(20) \) : B x (7) n U p — > Boo (t) n u p 

defined by projecting points along the center-stable manifolds is well-defined and 
is in fact a homeomorphism. On the other hand, since Ay p is a Cantor set (see 



Theorem 2.4), it follows that -Boo(t) n U p is also a Cantor set; hence 
(21) -600(7) Up contains neither isolated points nor connected components. 
Now let us show that away from isolated points, Boo (7) is a Cantor set. 



OPUC WITH FIBONACCI VERBLUNSKY COEFFICIENTS 



15 



Notice that the set of type-B points in M. is a closed set. For details see, for 



example, 39 Lemma 3.4]. Hence away from the finitely many isolated points, 



-Boo (7) is compact. At points of transversal intersection, (21 1 holds. Now, if q is 
a point of tangential intersection (but not an isolated point in -Boo (7)), then on a 
sufficiently small neighborhood of q, q is the only tangential intersection, by Lemma 



2.9 Hence for all points p sufficiently close to q, (21 ) holds, and we are done. □ 



As we mentioned earlier, the discussion above of dynamical spectra of analytic 
curves is inspired by a recurrent geometric scheme in spectral analysis of quasiperi- 
odic (particularly, Fibonacci) Hamiltonians. It turns out that spectra of those 
Hamiltonians (or essential spectra of CMV matrices) correspond to dynamical spec- 



tra of analytic curves that satisfy the hypothesis of Theorem 2.10 (or, cquivalcntly, 
of Corollary 2.11[ ). In this case, -Boo is a fractal, and more fine tuned analysis of 



Boo is required. We do this next. 
2.2.2. Dynamical Spectrum: Fractal Dimensions. For the remainder of this section, 



we assume that 7CM satisfies the hypothesis of Theorem |2. 10 

The following three theorems give a further qualitative description of the fractal 
nature of -800(7)- 

Before we continue, let us set up and fix for the remainder of this paper the 
following notation. The Hausdorff dimension of a set A will be denoted by dinin (A) . 
The local Hausdorff dimension of A C R at a € A is defined and denoted by 

diniH C (A, a) := lim dim H ((a - e, a + e) n A). 

The box-counting dimension of A (when it exists) is denoted by dime(^4), and the 
local box-counting dimension of A C K at a € A is defined analogously, and is 
denoted by dimg C (A,a). We denote the lower and upper box-counting dimensions 
of A by, respectively, dime (A) and dime (A) . 

Theorem 2.13. Take a € -Boo (7) cmd assume that a € Sy a - Suppose that a is not 
an isolated point of Boo (7) ■ Then 

(22) dim^ c ( J Boo(7),a) - ^dim H (A v J, 

where Ay a is the nonwandering set on Sv a from Theorem \2.4\ 

As a consequence of the preceding theorem we obtain the following two results. 

Theorem 2.14. The Hausdorff dimension of -Boo (7) is strictly between zero and 
one. Consequently, the Lebesgue measure of Boo (7) is zero. If 7 lies entirely in 
some Sy, then for every a <E -Boo(7), dimj^-Boo^), a) = dimH(-Boo(7)); otherwise: 

(1) Boo(j) 3»4 diniy C (.Boo(7), a) is continuous; 

(2) For a non-isolated point b G -Boo (7) and any e > 0, the local Hausdorff 
dimension along (b — e, b + e) fl -Boo (7) is nonconstant. 

Remark 2.15. To be completely clear, let us remark that by (b — e,b + e) we mean 
an e neighborhood of b along 7; cquivalcntly, if 7 is parameterized on [c, d] and 
B £ (c, d) is such that 7(B) = b, then we can speak of ~/(B — e, B + e). 

Regarding the box-counting dimension of -Boo (7) , we have 
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Theorem 2.16. Say a G -600(7) an( ^ U a a- neighborhood (in 7) of a, such that 
7 (1 U a intersects the center-stable manifolds transver ■sally. Then the box-counting 
dimension of U a n -600(7) exists and dimB(t/ a H -630(7)) = dunn(U a H -600(7))- 

Detailed proofs of these theorems appear in [40] for the special case when 7 is 
a line. Those proofs carry over essentially verbatim to the presently considered 
general case. We outline the main ideas below. 



Proof of Theorem 2.13 (outline). Assume p € -800(7) is a point of transversal in- 
tersection. Let Sv p , t and U p be as in the proof of Theorem 



proved in 40 that the map f), as defined in (20 1, is Holder continuous. Moreover, 



2.10 above. It is 



the Holder exponent can be taken arbitrarily close to one by making U p sufficiently 
small. It follows that the local Hausdorff dimension at p of -800 (7) coincides with 
that of -Boo(t). On the other hand, 

diiiiH C ( J 8 o(r),p) = ^dim H (Ay p ). 

(The last equality follows from results in hyperbolic dynamics; for details see, for 
example, [3j[4|[S] ) . 

Now, if q £ -600 (7) is a point of tangential intersection which is not an isolated 
point of -800 (7), let U e be an e- neighborhood of q along 7, such that for every 
P G -600(7) H U e \ {(?}, p is a point of transversal intersection (which, again, is made 



possible by Lemma 2.9). We have 



diuiH C (-8o 



.(7), q) 



lim dim H (Soo(7)nC/ e \M) 

e— >Q 



= lim 

e->0 



lim 



sup { diniH C (-800(7), P)\ 



sup 

iP es 00 ( 7 )n(7 e \{9} 



dim H (AyJ 



On the other hand, the map 



(23) V h-> dimn(Ay) is continuous 

(in fact smooth - see 24 , and in our case even analytic - see [3]). Hence 



lim 

e->0 



sup 

v pes x (7)n(7 e \{«} 



-dim H (A^ p 



-dim H (AvJ, 



where V q is such that q G S\r 



□ 



Proof of Theorem 2.14 (outline). The first statement of the theorem follows from 
the fact that dimH(Ay), V > 0, is strictly between zero and one (see |]). If 
7 lies entirely in some Sy, V > 0, then away from (finitely many) tangential 
intersections, -800 forms a so-called dynamically defined Cantor set (see 4,8), one 
of the properties of which is independence of local Hausdorff dimension on the point 
(see 



27 Chapter 4] for definitions and results). 



Finally, (1) follows from (23 1, while (2) follows from analyticity of the map in 



(23 1, together with the fact that 



lim diniH(Ay) 
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while for V > 0, diiriH(Ay ) e (0, 1) (notice that (b — e, b + e) n Boo (7) contains limit 
points). □ 



The proof of Theorem 2.16 is rather technical (even in outline form). We invite 



the reader to see 40 Proof of Theorem 2.5] for details. 



So far we have been concentrating on 7 g M. Occasionally, however, one needs 



to consider 7 with a point on Sq which is of type B (for example, see 40 Theorem 



2.3-ii] ) . In this case, we have the following addition to our existing results. 



We have already classified all type-B points in So in Section 2.1.1 hence if 7 
lies entirely in So, then -Boo (7) can be easily described by appealing to the results 
of the aforementioned section. Now let us handle the case where 7 C A4 U So, but 
does not lie entirely in So- 

Theorem 2.17. Suppose 7 is a compact analytic curve in M. U So with no self- 
intersections. Assume also that 7 does not lie entirely in So- Assume that 7 satisfies 
the hypothesis of Theorem 2.10 {or, equivalently, those of Corollary 2.11\ . Then 



Boo (7) is of type described in Theorem 2.10\ Moreover, if 7 n So contains type-B 



points, and at least one of these points is not an isolated point 0/ -630(7), then at 
that point the local Hausdorff dimension of B x (7) is equal to one; hence in this 
case the global Hausdorff dimension of 600(7) * s a ^ so equal to one. 

Proof of Theorem \2.11\ Suppose that p € Boo lies in 5*0 and is not an isolated point 
of -Boo- Since by assumption 7 does not lie entirely in So, analyticity of 7 and of the 
Fricke-Vogt invariant I implies that 7 must intersect So in at most finitely many 
points. Hence there exists a neighborhood of p, say U p , such that for all q G U p , 
with q 7^ p, q ^ So- Since p is not an isolated point, f7 p ["1-600(7) contains a sequence 
p n converging to p, and Theorem |2. 13| applies; that is: 

dimH C (-Boo(7),_P«) = ^dim H (AyJ, 

where V n > is such that p n € Sy n - Hence V n — > 0, and by the results of [8] we 
conclude that 

lim dim£ c (£U7),Pn) = L 

n— ^00 

Hence dimH(-Boo(7) H U p ) = 1, and therefore diniH(-Boo(7)) = diniH C (-Boo(7),p) = 
1. □ 

Let us conclude this section with the following result, which describes the de- 
pendence of the Hausdorff dimension of -600(7) on 7- 

Theorem 2.18. Suppose 7 is such that -Boo (7) is nonempty and does not contain 
any isolated points. Then diniH(-Boo(7)) depends continuously on 7 in the C 1 - 
topology. 

The proof of this theorem follows immediately from the previous discussion, 



in particular ( 22 ) . Let us only remark that the result fails if -Boo (7) contains 
isolated points. Indeed, say 7 is such that Boo (7) contains only one point, which 
is a point of quadratic intersection of 7 with a center-stable manifold. Then the 
Hausdorff dimension of Boo (7) is obviously zero. On the other hand, arbitrarily 
small perturbations 7 of 7 produce a Cantor set for -Boo (7) of strictly positive 
Hausdorff dimension, uniformly bounded away from zero. 
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2.2.3. Band Spectrum Approximation of the Dynamical Spectrum. By analogy with 
spectral band structure of periodic approximations to the quasiperiodic Hamilto- 
nians, we can construct approximations to B^ (7). One advantage of this general 
geometric construction, is that we can prove that these "band spectra" do in fact 
converge in Hausdorff metric to the actual dynamical spectrum #00(7). As a result, 
we can prove that the spectra of periodic operators that converge strongly to the 
quasiperiodic one, converge in Hausdorff metric to the spectrum of the quasiperiodic 
operator. 

Throughout this section, we assume that 7 C M. U So is compact, analytic and 
contains no self-intersections. 

For p £ 7, let the components of p be denoted by p x , p y , and p z . That is, 
V = {PxiPy-iPz)- Since 7 is compact, there exists C > 1 such that max p67 \p z \ < C . 

We assume that B^^) does not contain any isolated points (and is nonempty, 
of course). Let us define the nth approximant of B^ (7), or the band spectrum on 
level n, by 

M7) = {pe 7 :k°T>)|<C}, 

where 7r denotes projection onto the third coordinate. 

Before we state the result, let us quickly recall the definition of Hausdorff metric 
on 2 R . For any A, B C R, define the Hausdorff metric distn(A B) by 



distu(j4, B) = max < sup inf {\a — b\} , sup inf {\a — b\} 

iaeAbeB b£B a£A 

Unless there is danger of confusion, we shall drop 7 and write simply o~ n and B Q 
for <7„(7) and £00(7). 

The following theorem describes how B x is approximated by a n . 

Theorem 2.19. We have 

(24) B x = p| a n Ucr n+1 . 



Moreover, if 7 satisfies the hypothesis of Theorem 2.1C\ ( or, equivalently, Corollary 



2.11), and B^ does not contain any isolated points, then 



(25) cr„ — > Brx, with respect to the Hausdorff metric. 



A special, model-specific case of this result appears in 39 



Proof of Theorem 2.19 We begin with a lemma that characterizes a type-B point 



in terms of relative magnitudes of its components: 

Lemma 2.20. Given p ~ (p x ,p v ,p z ) G K 3 , and C > 1 is such that \p z \ < C , then 
p is not of type-H if and only if there exists N G N such that if (p^ , p y , p^ ) denotes 
T N (p), then 

(26) K|<C and \p£\ , > C. 

For the proof of the preceding lemma, see [5j Proposition 5.2], replacing 1 therein 
with C of Lemma [2~20l 

In what follows, for a point p = (p x ,Py,Pz) & K 3 , denote by p N = (p^ ,Py ,p%) 
the point T N (p). Observe that if p g 7 and for some N > 1, p N ^ oat U ctjv+i, then 
p N satisfies (26) and so p is not of type B. Conversely, if p € 7 is such that for 



all n, p G er n U er„+i, then for all n, \p^\ < C, for some a £ {x, y, z}. Application 
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of Proposition |2.1| then guarantees that p is of type B. In other words, we have 



proved (24 1 



Let us now prove ( 25 ) . Let e > chosen arbitrarily, and let C% , . . . , C m be open 
sets of radius not larger than e covering the compact set . It is enough to show 
that there exists N £N such that for all n > N, a n (1 C° = and a n n Ci ^ for 
all i £ {1, . . . , m}. 



Certainly since every p £ B c x is not of type B, for each suchp, by Proposition 2.1 

there exists N p £ N such that for all n > N, pf p > 1. By compactness of 7, there 

exists a common N £ N, such that for all p £ (Ul=i Ci) c , and n > N, \p^\ > 1; 
that is, p a n . Hence for all n > N, cr n n Cf = for alH € {1, . . . , m}. 

Let us now return to the curve of period-two periodic points going through 



Pi = (1, 1, 1), which we denoted by p\ (see Section 2.1.1 1. Observe that p\C\Sv, for 
any V > 0, consists of two period-two periodic points p l v and p r v with T(p l v ) = p r v 
and T(py) = p l v . Consequently these points belong to Ay, and to each of these 
points there is attached a stable manifold, say W s (py). Each of these two manifolds 
is dense in the lamination of stable manifolds on Sy (see [3]). Recall also that Pi 
is a cutpoint of pi, dividing it into two smooth curves p\ and p\, each contained 
entirely in M , with p l v = p\ fl Sv and py = p\ n 5y . These two curves are normally 
hyperbolic, as was discussed in Section [2.1.1[ and consequently the stable manifold 
attached to each of these curves forms a dense sublamination of the lamination by 
center- stable manifolds. Let us call these manifolds W l and W r . It follows that 
for each i £ {1, . . . , m}, there exist points p\ and p\ in d n B^, with p l - r £ W l,r . 
Observe that the points on p\ are of the form 

X '2x^l' X ) With xG (-°°'l) U (l' oc 

Consequently, if p l v — (x, xj (2x — 1), x), then p v — (xj (2x — l),x,x/(2x — 1)). If 
x = 1, then we get P±, which does not interest us, since Pi £ So. Otherwise, either 
|a;| < 1 or \x/(2x — 1)| < 1; that is, either the absolute value of the z-component of 
Py, or that of p v , is strictly smaller one. It follows that for all sufficiently large n, 
either the absolute value of the z-component of T n {p\) or that of T n (p£) is strictly 
smaller than one; hence either p\ or p\ belongs to a n . Therefor, for all sufficiently 
large n, a n n Ci ^ 0. □ 

So far we have carried out a qualitative (albeit rather detailed) analysis. Cer- 
tainly, quantitative results are desired (such as estimates on fractal dimensions); 
however, even in model-specific cases such results are rather scarce and are no- 
toriously difficult to obtain. This, among other things, will be the focus of our 
attention in Section [3] We shall comment further on previous model-specific quan- 
titative results, as well as provide relevant references to previous works, in that 
section. 



3. The Fractal Dimension of the Essential Support 

In this section we apply the results from Section [2] to the special case of interest 
in this paper. That is, we consider the set E a ^ associated with the Fibonacci 
substitution on two elements of the open unit disk in C and investigate its local 
and global fractal dimension by relating these quantities to the associated curve of 
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initial conditions and the general results for the Fibonacci trace map presented in 
the previous section. 

Let us fix a, (3 € D, a 7^ /3, and consider the associated one-sided infinite word 
w Qj( 3 over the alphabet {a,f3} that is invariant under the substitution S(a) = a/3 
and S(0) = a. 

As explained in the beginning of Section[2j the relevant curve of initial conditions 
for the OPUC problem generated by Verblunsky coefficients ^ a ,0 is given by 

( w l/2 +w -l/2 w l/2 +w ~l/2 R X 
7a,p(w) ■= (Xi{w),Xo{w),X-i(w)) = , , , 



2p ' 2a 2pa J ' 

where p = y/l — \a\ 2 , a = — |/3| 2 , and K = 2(1 — Re(a/3)). We are interested 
in those points on the curve of initial conditions 7 Q , l s, which are of type B. The 
corresponding iv's form the set £ a ,/9j which is the essential spectrum of C u and the 
essential (topological) support of fj, u for every u> € fl a ,p- 

Theorem 3.1. The set S Q / 3 equals {w € dD : 'ja.piw) is a type-H point} and is a 
Cantor set of zero Lebesgue measure. 

This was first proved in 35 12.8] and has been further elucidated in Section [2] 
An important remark is that the set of points satisfying (2) in |35| Proposition 



12.8.6] is empty: this is Proposition 2.7 



Since the set S Q ,/3 is known to be a Cantor set of zero Lebesgue measure, it is 
clearly of interest to study quantities such as fractal dimensions. Section [2] provides 
all the necessary general results, so that we may now exploit those, along with 
quantitative information obtained in the study of the Schrodinger case. 

We first note the following: 

Theorem 3.2. There is a finite set F a _p C E ai| g such that for w € £ Q ,/3 \ Fa,/3, 
dimg C (S Q!/ 3; w) exists and is equal to dim^ c (E Qj( 3; w). 

Proof. Since the curve of initial conditions is analytic and it is contained in no 
single invariant surface, it may have only isolated tangencies with invariant surfaces. 
Therefore Theorem |2.16| applies. □ 

Local dimensions such as dimg c (S Q , i ^; w) and dimy c (E Q . / g; w) will depend on the 
value the invariant / takes at the point w € S a ,^. Recall from Section [2] that 

/ 1 1 K \ K 2 -2K 1 1 

I(w) = Rew — + —r - H —r-^ h —r + — - 1. 

\2p 2 2o 2 2p 2 a 2 ) Ap 2 a 2 2o 2 2p 2 

Since the spectral parameter w belongs to the unit circle, / as an affine function of 
Rew; takes its maximum/minimum at ±1. In particular, we have 

1 1 K 2 -AK 
1(1) = ^ + ^+ . 22 -L 

so that a short calculation shows 

1(1) < <=> |Re(S/3)| < \af3\. 

As a consequence, we see that / may take negative values for a, f3 g D and w E dD 
suitably chosen. This observation is of interest since in all previous studies of models 
derived from a sequence invariant under the Fibonacci substitution, negative values 
of the invariant never occurred. This potentially complicates the situation in the 
OPUC setting. 
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On the essential spectrum, however, the invariant will always be non-negative: 
Proposition 3.3. We have I(w) > for every w £ £ a £. 

Proof. Assume there exists w € S Qj/ g such that I(w) < 0. Since w G S a ^, ^ a ,p{w) 



is a type-B point due to Theorem 3.1 By the assumption I(w) < and continuity 
of /, the same will be true in a sufficiently small neighborhood (in dO) of w. Thus, 
nearby points w' have negative invariant and give rise to type-B points 7 Q „a(w/) 



as well (this follows by Lemma 2.3). This shows that an open neighborhood of w 



belongs to S Qj ^, contradicting the fact that S a ,/3 is a Cantor set. □ 

This shows that, while I(w) may in principle take negative values, for a spectral 
analysis of the OPUC problem, it is sufficient to study the trace map dynamics on 
the invariant surfaces corresponding to non- negative values of the invariant. Hence 
the potential complication alluded to above is actually quite tame and does not 
cause any real challenges. 

Let us now establish estimates of the local Hausdorff and box-counting dimen- 
sions under the premise that I(w) is large enough. Since we will deal in particular 
with points of the spectrum where / is greater than 16 or 4, we give a simple 
condition for the existence of such points: 

Proposition 3.4. Suppose that a — and let M > be given. Then if p 2 = jjxj, 
M is the maximum value attained by I on T. 



Proof. Since a — 0, a = 1. Thus 

1 1_\ _ 1 J_ 

2 ~ vj ~ 2 + V' 
This function attains its maximum at Re w — — 1. so that 



I(w) = Hew 



_ _ f I _ _L_\ _ 1 _L_ 1_ 

\2 2p^J 2 + 2^~p^ ' 
as required. □ 

From this proof, it is also evident that (when a = 0) 1(1) = 0, but that by taking 
|/3 1 close enough to 1, the set of points on dD where / is greater than any fixed M 
can have Lebesgue measure arbitrarily close to 2tt. 

Theorem 3.5. With the finite set F a ^ C S a!( g from Theorem 3.2, sup- 
pose that w € £ Qj) 3 \ -Fq,/3- Denote S u (w) — 4y / 7(w) + 22 and Si(w) = 

\ \2^T{w) - 4 + y/(2y/I(w)- 4) 2 -12^ . Then, 

I(w) > 4 =*> dimH C (S Q ,/3; w) = dimB C (S Q!( 3; w) > y^yry^y 



and 

I(w) > 16 dimg c (S Q ^; w) = dimg c (E Q ^; w) < 



!...,v ., ,;. .I....X- . x / l<>g(l + V^) 



log Si(w) 

Proof. Let us consider an arbitrary w £ £ Q ,/3 \ Fa,p- Set V = I(w), so that 
la.j3{ w ) € Sv- By Theorem 



2.13 



dim^E^; w) = diniB C (£ Qi) g; to) = ^ dim H (A v ) 



22 



D. DAMANIK, P. MUNGER, AND W. N. YESSEN 




FIGURE 4. An illustration of the idea behind the proof of Theorem |3. 5 1 

The quantity | dining Ay) was estimated in [6] from above and below, namely by 
implementing Theorem |2.13| for the particular case of the curve C of initial condi- 
tions in the Schrodinger case (with the coupling constant A chosen so that V = ^-) 
and then to use periodic approximation to obtain the desired dimension estimates 
from scaling properties of the spectra of the periodic approximants. The upper and 
lower bounds obtained in [6] yield the estimates claimed in the present theorem 
via the connection just described; see Figure [3] for an illustration. The assumption 
A > 4 (resp., A > 8) necessary for the lower (resp., upper) bound from |6 to hold 
translates via I(w) = ^ to the assumption I(w) > 4 (resp., I(w) > 16) in the 
present context. □ 

Remark 3.6. Generically, the curve 7 of OPUC initial conditions and the curve 
C of Schrodinger initial conditions never intersect. In fact, they only do so when 
a = f3 and the Schrodinger coupling constant X is 0. In this case 7 is contained in 
C. 

Proof. The curve C of Schrodinger initial conditions is given by C(E) = {{E — 
X)/2,E/2, 1). Therefore K — 2po is a necessary condition for j(w) to lie on the 
curve C for some w. Writing a — re and f3 = te 1 ^ , the equation K = 2pa is the 
same as 

1 - rt cos(V> -9) = v/(l-r- 2 )(l-i 2 ). 
Choosing arbitrary 9, r, and tp we consider the equation as a quadratic polynomial 
in t: 

t 2 (r 2 cos 2 (i/> - 9) + 1 - r 2 ) - t(2r cos(^ - 9)) + r 2 = 0. 
The equation has a real solution in t when the discriminant is nonnegative: 
4(cos 2 (V^ - 6>) - 1) - 4r 2 (cos 2 (V> - 9) - 1) > 0. 
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This only happens when ip — 9. Verifying that this implies r — t is straightforward, 
and it now follows that A = if 7 and C intersect. □ 



As a consequence of Theorem 3.5 we see that the local dimension of S Q ,/3 near 
one of the points w in question is asymptotic to log ^ 1 1— ^2 in the large invariant 

logyl(«;) 

regime. As far as the asymptotic behavior for small values of the invariant is 
concerned, we have the following result. 

Theorem 3.7. There exists Iq > such that the following holds. With the finite 



set F a _p C E a a from Theorem 3.2 suppose that w € ^ a ,/3 \ J? a p. Then, 

0<I(w)<I 1 - dimH°(SQ,/3; w) = 1 - dim£ c (Y, ayl3 ; w) ~ a/ I(w), 

where a ~ b means that C~ 1 a <b<Ca for some universal positive constant C . 



Proof. This follows from [8j in the exact same way that Theorem 3.5 was derived 



from [6j. □ 
4. Results for Individual Elements of the Subshift 

Up to this point, the distinction between u a ,p and an arbitrary element w of 
f2 Qj( 3 was not necessary as the essential spectrum of the associated CMV matrix 
is the same throughout the entire family. In this section we consider quantities 
that may indeed depend on the choice of w € il a ,p- Recall that once such an uj is 
chosen, it provides a sequence of Verblunsky coefficients, and hence determines a 
probability measure on the unit circle and a CMV matrix acting on £ 2 (Z + ). On 
the other hand, in analogy to the known results in the Schrodinger context, one 
expects to be able to prove uniform results, that is, results that hold uniformly for 
all uj 6 Sl a ,p. This is a consequence of the rigid subword structure of the elements 
of the subshift, and more specifically, the fact that most subswords of Fibonacci 
length are cyclic permutations of the canonical word of this length from which the 
corresponding trace in the trace map approach is derived. 

4.1. Absence of Point Masses Inside the Essential Support. In this sub- 
section we show that the restrictions of the measures fi u to their essential support 
are purely continuous, that is, they have no point masses. The proof proceeds by 
showing that for any w € cr css (/i u ) (which is equal to S a ^), the orthonormal poly- 
nomials tp n (w) associated with fi u are not £ 2 at the w in question, which in turn is 
a consequence of the so-called Gordon Lemma and boundedness of transfer matrix 
traces. In fact, we prove this result for all the Aleksandrov measures derived from 
fj, u , that is, uniformly in the boundary condition of the half-line problem. 

Let us recall the basic connection between point masses and square-summability; 
compare 



34 Theorem 2.7.3]. 



Lemma 4.1. Let pi be a non-trivial probability measure on dD and let w £ dO. 
Then n{{w}) ^ if and only if J2 n >o Wniw; ^)\ 2 < 00. 

Recall from ([T]) that 
where 

(28) T n (w;n) = A(a n _i(/i),u;) • • • A(a ((i),w) 
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and 
(29) 



A(a,w) = (l-\a\ 2 )- 1 / 2 



w 

-aw 



-a 



Recall also that the family of Aleksandrov measures {fix ■ A € <9B} associated 
with a non-trivial probability measure fi on <9B is defined by 

u n {n\) = Aa„(/i). 

Since we will be interested in the family of Aleksandrov measures associated with 
a measure generated by Fibonacci Verblunsky coefficients, we will need a version 
of ( 27 )— ( 29 ) for fi\ instead of just fi. It follows from [34, Proposition 3.2.1] that 



(30) 



T n (w,fl) 



We can now prove the main result of this subsection: 

Theorem 4.2. For every uj € £l a ,/3 cind A € dO, we have /j.uj,\{{w}) = for every 
w e (t css (^,a) (= ^a,p)- 

Proof. Fix uj £ fl a ,/3, A e <9B, and w G o- esa (fi Ul x)- If we can show that 

oo 

(31) ^2 /Va)| 2 = oo, 

n=0 



the result then follows from Lemma 



4.1 



Since (p* (w; fj, u> x) = w n f n (w; fJt Ut x), we 



have (w; f^u,x)\ = |Vn(^; M«,a)| for every n > 0. In other words, (31 1 is equiva- 
lent to 



(32) 



n=0 



oo. 



Since a ess (fj, UJt \) does not depend on A (i.e., a ess (jx Uj x) = o- ess (fi Ul i) = E a ,^) 
by [MJ Theorem 3.2.16], it follows from what we already know that for the 
special element u) a ,f) of f2 a „8 that is invariant under the Fibonacci substitution, 
[Tr Tp k (w; ji ula remains bounded as k — > 00, say by C. It was shown in [9j that 
for the given w, there are infinitely many k such that uj n+ p k = u n for 1 < n < 



and ui\.. .u>F k is a subword of cj* 



J 2F, 



, that is, it is a cyclic permutation of 



By cyclic invariance of the trace, it follows that |Tr Tp k (w; fi u ,i)\ < C 



for these infinitely many values of k. 
Now, for such k's, (30) implies that 

<PF k ( w '> Mu>,a) 

<P*F k ( W '> Vu,*) 



and 



/" <P2F k {w; fJ, u ,X, 

\}P*2F k ( w i^,\, 



T Fk {w; fi u 



T2F k {w;fi Ut i 

where we also used (28). By the Cayley-Hamilton Theorem, this gives 

^2F k {w;^.x)\ 1 - 1 



ipF k (w, fj, u> x) 

^k(w;/VA) 



> 



2C%/2' 



Since we have this estimate for infinitely many k, (32) follows. 



□ 
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Clearly, the support of /j>uj,\ is the disjoint union of <7 css (/i w .a) and the isolated 
points outside this set that have non-zero weight with respect to (J.^^- These 
isolated points are clearly point masses for the measure, while Theorem |4.2| shows 
that fi Ut x is purely singular continuous on the zero-measure set cr css {^uj.\) (assuming 
the non-trivial case where a, (3 are not equal). It was shown by Simon in [35] that 
for every oj G f2 Qil a and Lebesgue almost every A € <9D, the measure is pure 
point. That is, combining the two results, we see that it can happen that one of 
these two components has zero weight, and in fact it often does so. 



Another consequence of Theorem 4.2 is that the natural two-sided extension of 



any non-trivial Fibonacci CMV matrix has purely singular continuous spectrum. 
This follows since the two-sided extension has purely essential spectrum, which is 
equal to the essential spectrum of the one-sided matrix. 



4.2. Growth Estimates for the Orthogonal Polynomials. Equation (30) 
shows that growth (and decay) properties of the normalized orthogonal polyno- 
mials are intimately connected to growth properties of the transfer matrices. For 
n a Fibonacci number and w G S Q ( g, the traces of these matrices are bounded 
in n by an /(w)-dependent bound. The recursion ([2| can then be used to derive 



norm estimates from these trace estimates, as observed by Iochum-Testard 21 
and Damanik-Lenz [10] . In this subsection, we follow this approach and derive the 
resulting estimates. 

First we need some extra notation. Define M(n, m, oj, w) to be the transfer 
matrix at w across oj G £l a .b restricted to the subword ranging from place m to 
place n, multiplied by uH m ~"l/ 2 , so that w~ n / 2 T n (w; = M(n, 0, oj, vj). Further, 
define M n (w) = M(f n , 0, x, w), where x is the standard Fibonacci word upon which 
Q a ,b is based. Finally let r{w) be the largest root of the polynomial x 3 — (2 + 
2y/l(w))x — 1. It is given by 



(27 +7729 - 864(1 + x /7H)3) 1 /3 2-2^(1 + JIM) 

r(w) = 



3 ' 2V3 (27 + ^729 - 864(1 + yi(^) 1/3 

Theorem 4.3. If w G S Q ( g and 

log((5 + 4 v /I( W )) 1 / 2 (3 + 2jl{w))r(w)) 
^ log^ 
then for a suitable C , we have that 

sup \\T n (w; fi^W < Cn< 

for every n G Z + ; and therefore \<p n (w; ^u>)\ < Cn 1 . 

As pointed out above, we follow the approach developed in the Schrodinger 



case by Iochum-Testard 21 and Damanik-Lenz [10] and adapt it to the OPUC 
setting considered in this paper. The main idea is to use the trace estimates for 
canonical building blocks along with a partition of general finite subwords appearing 
in subshift elements in terms of the canonical building blocks in order to derive norm 
estimates for the general finite subwords. 

The canonical building blocks are the prefixes of the special element oj a ^ of the 
subshift Q a p that have length given by a Fibonacci number. The transfer matrices 
over these building blocks have traces bounded in absolute value by a constant that 
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depends on the value of the invariant at the spectral parameter w. This dependence 
of the bound on w motivates a quantitative study based on the value of I(w). In this 
context we would like to mention also the paper [8] which worked out a quantitative 
version of [2l] and [lO] in the Schrodinger case. 

Lemma 4.4. (1) If w £ S Qj /3 7 |x n (wj)| < 1 + \Jl{w) for all n. 
(2) For some positive C(w) and for all n £ N, w € ^ a .p, 

\\M n (w)\\ <C(w)r{w) n . 

Moreover, max ffi£ s„ » C(w) —: C exists, and likewise for r(w), so that 

\\M n (w)\\ < Cr n . 

Proof. This proof mimics the proof of [8] [Lemma 5.3]. 

We will prove part (b). Recall that M n (w) is the matrix w~^ n ^ 2 Tf ri {w) 1 so that 
x n {w) — ^txM n {w). The Cayley-Hamilton theorem gives M n (w) 2 +2x n (w)M n (w)+ 
I = 0, or M n = 2x n I — M~ x . Using the recursion for M n , 

M n = M n - 2 M n -i = M n - 2 {2x n - X I - M~\) = 2x n -xM n - 2 - M~± 3 . 

Since ||M n || = M" 1 !!, the above yields 

||M„H|| = (2 + 2^1{w)) ||M„_ 2 H|| + ||M n _a(«;)|| , 

for all w G S. 

Compare this estimate to the recursion 

m n = (2 + 2vJ)m„_2 + m„_ 3 

with initial conditions mi = ||Mi(w)||, = ||Af2(w)||, 7713 = ||M3(u>)||, so that 
|| M n || < m n . Any solution to the recursion is of the form 

m„ = c 1 (w)r 1 (w)" + c 2 (w)r 2 (w) n + c 3 (w)r 3 (w) n , 

where the rj are the roots of the characteristic polynomial x 3 — (2 + 2\[T)x — 1 to 
the recursion. 

One can compute 

- ||M 2 || + ||Afi|| r 2 + ||Mi|| r 3 - ||M || r 2 r 3 



ci = 



r\ir 2 - ri)(r 3 - r\) 



and similar expressions for c 2 and c 3 . Taking r\ = r to be the largest root, the 
function 

aw) = Cl (w) + C2(w) ; 2H + C3(w) ; 3 ? w) 

ri(w) ri{w) 

satisfies 

||A/nMII <C(w)r(w) n , 

proving the first part of the lemma. One can check that none of the roots rj{w) is 
ever zero, so that C is a continuous function of w. The second part of the lemma 
now follows from compactness of E a p. □ 

Lemma 4.5. For all n>\, k >{), 

M n M n+k — M n+ k + -ffc 2 ' ] Mn+k-i + -P/P' Af„+fe_2 + Pjf 1 !-, 
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where are scalars depending on n and w. Moreover, for every n > 1 and 

w € S, 

4 

E I^MI < (5 + 4 V / ?H)(3 + 2v^H)L fc / 2 J . 

3=1 

The proof of the OPRL version of this lemma carries over from [8] with no 
change. 



Lemma 4.6. If I(w) > and 7 obeys the hypothesis of Theorem 4-3 there is a 
constant K such that 

\\T n {w)\\<Kn> 

for every n > 1. 

The proof of this lemma also carries over from [8]. One first writes n as a 
sum of Fibonacci numbers, in the so-called Zeckendorf representation, to obtain 
||T n || = \\M no M ni . . .M nK \\. The construction is such that F nic <n< F„ K+ i and 
^2(K-i) ^ n - Inducting on K, we can apply the estimate from Lemma 



\\M no M ni . . . M„ K || < C(5 + 4VJ) K V3 + 2y/l (YV 3 + 2y/l) n '< . It follows 

that 

hm sup — 

n-yoo log n 

log ( C(5 + 4\Z7)*V3 + 2V7 2(ir_1) ""°(rV3 + 2v7)" K J 
< lim sup — 

n->oo log 71 

#(n) log(5 + 4V 7 /) + (2(Jf - 1) - no) log y/S + 2y/l + n K log(r ^3 + 2y/l) 



4.5 



to get 



< lim sup 



< 



log n 

log((5 + 4y / 7) 1 / 2 (3 + 2V7)r) 
log VE+i 



2 

which proves the estimate. 



Proof of Theorem 4^3 Given ui G £l a ,&, n > m, w £ S Qj( 9, and 7 obeying the 
hypothesis of the theorem, we will show that 

\\M(n,m,u!,w)\\ < C(n — m) 7 

for a suitable constant C, which implies the theorem. 
As explained in [9], we can write 

w„...w m = xyz, 

where y is a word of length two in a, b and x R (the reverse of x) and z are prefixes 
of uj a ,(3- Thus 

||M(u>,o;)|| < ||M(«;,x)|| • \\M{w,y)\\ • \\M(w,z)\\ . 
Now || M(w, x R ) || = at) || (|9, Lemma 5.1]). Moreover, from Lemma 



4.6 



M(w,x R )\\ < K\x\^ and ||M(w,z)|| < K\z\~t . This proves the theorem. □ 
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Appendix A. Background on Uniform, Partial and Normal 

Hyperbolicity 

In this appendix we give a (very brief) overview of the necessary notions from the 
theory of hyperbolic dynamical systems. The discussion below appeared originally 



in 39 . 



A.l. Properties of Locally Maximal Hyperbolic Sets. A more detailed dis- 



cussion can be found in 15 16.18-20 



A closed invariant set A C M of a diffeomorphism / : M — > M of a smooth 
manifold M is called hyperbolic if for each x € A, there exists the splitting T X A — 
E X Q)E X invariant under the differential Df, and Df exponentially contracts vectors 
in E x and exponentially expands vectors in E%. If A = M, then / is called an 
Anosov diffeomorphism. 

The set A is called locally maximal if there exists a neighborhood U of A such 
that 



(33) A =f| P(U). 



The set A is called transitive if it contains a dense orbit. It isn't hard to prove that 
the splitting E s x © E™ depends continuously on x g A, hence dim(Ep u ) is locally 
constant. If A is transitive, then dim(Ep u ) is constant on A. We call the splitting 
E X ®E X a (k x , fc") splitting if dim(E x ' u ) = fc s '", respectively. In case A is transitive, 
we'll simply write (k s , k u ). 

Definition A.l. We call A C M a basic set for f € DifT(M), r > 1, if A is a 
locally maximal invariant transitive hyperbolic set for f. 

Suppose A is a basic set for / with (1, 1) splitting. Then the following holds. 
A. 1.1. Stability. Let U be as in (33). Then there exists U C Diff 1 (M) open, con- 



taining /, such that for all g g 14, 

(34) A g = P| g»(U) 

is g-invariant transitive hyperbolic set; moreover, there exists a (unique) homeo- 
morphism H g : A — » A g such that 

(35) H g of\ A =g\ Ag oH g . 

Also H g can be taken arbitrarily close to the identity by taking U sufficiently small. 
In this case g is said to be conjugate to /, and H g is said to be the conjugacy. 

A. 1.2. Stable and Unstable Invariant Manifolds. Let e > be small. For each x G A 
define the local stable and local unstable manifolds at x: 

W!{x) = {yeM: d(f n (x), f n (y)) < e for all n > 0} , 

W?(x) = {yeM: d(f n (x), f n (y)) < e for all n < 0} . 
We sometimes do not specify e and write 

Wfjx) and W? oc (x) 
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for W/(x) and W"(x), respectively, for (unspecified) small enough e > 0. For all 
x £ A, W£"(x) is an embedded C r disc with T x W£"(x) = E s x ' u . The global stable 
and global unstable manifolds 

(36) W s (x) = |J r n (Wf oc (x)) and W(x) = |J f n (W? oc (x)) 

are injectively immersed C r submanifolds of M. Define also the stable and unstable 
sets of A: 

(37) W S (A) = (J W s {x) and W U (A) = \J W u (x). 

If A is compact, there exists e > such that for any x,y £ A, W^{x) n 
consists of at most one point, and there exists 5 > such that whenever d(x, y) < 5, 
x,y £ A, then W£(x) n W"(y) ^ 0. If in addition A is locally maximal, then 

W*(x) n w e u (j/) e A. 

The stable and unstable manifolds Wj*'" (x) depend continuously on x in the sense 
that there exists <5 S '" : A — » Emb r (R., M) continuous, with $ s '"(x) a neighborhood 
of x along W£"(x), where Emb r (R,M) is the set of C r embeddings of K into M 



19) Theorem 3.2]. 

The manifolds also depend continuously on the diffeomorphism in the following 
sense. For all g £ DifT(M) C r close to /, define : A g -> Emb r (IR, M) as we 
defined $ s,tl above. Then define 

: A -> Emb r (R,M) 

by 

Then depends continuously on g fl9) Theorem 7.4]. 

A. 1.3. Fundamental Domains. Along every stable and unstable manifold, one can 
construct the so-called fundamental domains as follows. Let W s (x) be the stable 
manifold at x. Let y S W s (x). We call the arc 7 along W s (x) with endpoints y 
and f~ 1 (y) a fundamental domain. The following holds. 

• /(7) n W s (x) = y and / _1 (7) n VF s (x) = and for any k £ Z, if 
k < -1, then / fc ( 7 )nr(i) = 0; if fc > 1 then / fc ( 7 ) n W s (x) = iff x + y; 

• For any z £ W s (x), if for some k G N, / fe (.z) lies on the arc along W s (x) 
that connects x and y, then there exists n £ N, n < fc, such that f n (z) £ 7. 

Similar results hold for the unstable manifolds, after replacing / with / . 

A. 1.4. Invariant Foliations. A stable foliation for A is a foliation T s of a neighbor- 
hood of A such that 

(1) for each x £ A, T(x), the leaf containing x, is tangent to E s x \ 

(2) for each x sufficiently close to A, f(J 7S (x)) C J 7S (f(x)). 

An unstable foliation J- u is defined similarly. 

For a locally maximal hyperbolic set A C M for / £ Diff 1 (M), dim(M) = 2, 
stable and unstable C° foliations with C 1 leaves can be constructed; in case / <E 



Diff (M), C 1 invariant foliations exist (see 27 A.l] and the references therein) 
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A. 1.5. Local Hausdorff and Box-Counting Dimensions. For x £ A and e > 0, con- 
sider the set W*' u (1 A. Its Hausdorff dimension is independent of x g A and e > 0. 
Let 

(38) h s < u (A) = dim H [W°> u (x) n A). 

For properly chosen e > 0, the sets W"' u (x) fl A are dynamically defined Cantor 
sets, so 

h s ' u (A) < 1 



(see 27 Chapter 4] ). Moreover, h s,u depends continuously on the diffcomorphism 
in the C 1 -topology [25]. In fact, when dim(M) = 2, these are C r_1 functions of 
/ £ Diff r (Af), for r > 2 [24]. 

Denote the box-counting dimension of a set V by dimBox(r). Then 

&im H {W!' u {x) n A) = dim Bo x(VF e s ' tl (a;) n A) 



see 25 38H 



Remark A. 2. for hyperbolic sets in dimension greater than two, many of these 
results do not hold in general; see f28V for more details. 



A. 2. Partial Hyperbolicity. For a more detailed discussion, see 

An invariant set A C M of a diffeomorphism / £ Diff' (M), r > 1, is called 
partially hyperbolic (in the narrow sense) if for each x € A there exists a splitting 
r a M = E X (BE X (BE X invariant under Df, and Df exponentially contracts vectors in 
E x , exponentially expands vectors in E x , and Df may contract or expand vectors 
from E%, but not as fast as in Ep u . We call the splitting (fc^,fc^,fc") splitting 
if dim(£^' c ' n ) = k s x ' c ' u , respectively. We'll write (k s ,k c ,k u ) if the dimension of 
subspaces does not depend on the point. 



A. 3. Normal Hyperbolicity. For a more detailed discussion and proofs see 20 
and also [29] . 

Let M be a smooth Riemannian manifold, compact, connected and without 
boundary. Let / £ Diff r (M), r > 1. Let A be a compact smooth submanifold 
of M, invariant under /. We call / normally hyperbolic on N if / is partially 
hyperbolic on N. That is, for each x £ N, 

T X M = E s x @E c x ®E x l 

with E x = T X N . Here E x ' c,u is as in Section |A.2| Hence for each x £ N one can 
construct local stable and unstable manifolds W* (x) and W™(x), respectively, such 
that 

(1) x£Wf oc (x)nW l l c (x); 

(2) T x W? oc (x) = E*(x), T x W^{x) = E u (x); 

(3) for n > 0, 

d{f n (x),f n (y)) > for all y £ W{ oc (x), 

n—>oo 

d{f- n (x), f- n {y)) > for all y £ W? oc (x), 
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(For the proof see 29 Theorem 4.3]). These can then be extended globally by 

w s {x) = |j r n f(wf oc (x)) 



ner 



W U {X) = |J fWocW) 

Set 

W£ C (N) = |J WUx) and W&{x) = |J 



Theorem A.3 (Hirsch, Pugh and Shub [20]). The sets Wf Q s c (N) and W{%.(N), 
restricted to a neighborhood of N , are smooth submanifolds of M. Moreover, 

(1) W™ c (iV) is f -invariant and Wj™ is / _1 -invariant; 

(2) N = W£ c (N)r\W&(N); 

(3) For every xGN, T x W£> cu (N) = E s x u ® T X N ; 

(4) (N) (W{^(N)) is the only f -invariant (f -invariant) set in a neigh- 
borhood of N ; 

(5) Wfo c (N) (respectively, W{^ C (N)) consists precisely of those points y G M 
such that for all n > (respectively, n < 0), d(f n (x), f n (y)) < e for some 
e>0. 

(6) W™r( N ) is foliated by {W s ^ c {x)} x£N . 
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